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(54) Progressive streaming media rendering 

(57) A system and process for providing progres- 
sively higher quality versions of an audio and/or video 
program over a client-server based network. In re- 
sponse to a user command to view a particular program, 
the client requests layered data associated with the pro- 
gram from the server. The client also specifies how 
many consecutive layers are to be transmitted based on 
the bandwidth available on the network. The client then 



receives the data from the server, caches it, renders it 
as it is received, and presents it to the viewer. Upon a 
request from the user for a higher quality version of the 
program, the client requests as many enhancement lay- 
ers associated with the program as possible given the 
available bandwidth. The client receives the requested 
data, combines it with the previously stored lower-level 
layer data, renders the higher quality version of the pro- 
gram, and presents the new version to the user. 
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Description 

Background of Invention 

Technical Field: 5 

[0001] The invention is related to streaming media 
rendering, and more particularly to a system and proc- 
ess for obtaining progressively higher quality versions 
of an audio and/or video program over a client-server 
based network. 

Background Art: 

[0002] Audio and video infonnatlon is commonly sent 
firom a server to a client over a network connection, par- 
ticularly over the tntemet. For example, many news and 
sports web sites on the Internet contain short video clips 
which can be accessed by a user. One typical way that 
this happens is for a user to download the data associ- 
ated with the desired clip. This is accomplished by a cli- 
ent computer associated with the user making a request 
for the data from a server upon which the data is resi- 
dent. The server then transfers the requested data to 
the client via the network. Once all the data has been 
received by the client, the client computer renders it and 
presents it to the user in the normal manner. However, 
when data is transferred over a network, and particularly 
over the Internet, the channels between the server and 
client can vary dramatically in capacity, often by two or 
three orders of magnitude. These differences in capac- 
ity exist because the data transmission rates associated 
with the connections to a particular client can vary (e.g., 
phone line capacity, LAN and/or modem speeds). This 
heterogeneity in capacity can cause problems, particu- 
larly if high quality audio and video is desired. For ex- 
ample, downloading a high quality, and therefore large 
bandwidth, version of an video dip from a website on 
the Intemet could mean waiting for much longer than 
the duration of the clip Itself. Thus, the user has to wait 
to see the video clip, often with the result of frustrating 
the user. Furthermore, the user may not know if the vid- 
eo clip is of interest without viewing it, so waiting to 
download something that may not even be interesting 
is doubly unattractive. 

[0003] The downloading issue can be avoided by us- 
ing a form of audio and video data transfer referred to 
as a real-time unicast multimedia presentation. Essen- 
tially, this scheme involves streaming data associated 
with a requested video program from the server to the 
client over the network. As the data is received by the 
client, it is rendered and presented to the user on a near- 
ly real time basis. However, the aforementioned band- 
width limitations typical of a network, and particularly the 
Intemet, also create problems for this type of transfer. 
For example, the typical bandwidth available on a net- 
work like the Intemet is inadequate to allow the stream- 
ing of a high quality color video. Thus, a particular client 



may not have the bandwidth available to receive the 
highest quality transmission that a server is capable of 
providing. 

[0004] To overcome this bandwidth problem, audio 
and video information can be transmitted via a layered 
scheme, in a layered scheme, audio and video informa- 
tion is encoded in layers of importance. Each of these 
layers is transmitted in a separate data stream, which 
are in essence a sequence of packets. The base layer 
is an information stream that contains the minimal 
amount of information, for the least acceptable quality. 
Subsequent layers enhance the previous layers, but do 
not repeat the data contained in a lower layer. In order 
to obtain the higher quality, a client must receive the low- 
er layers in addition to the higher layers that provide the 
desired quality. Thus, the layers are hierarchical in that 
there is at least one base layer, and one or more addi- 
tional higher level enhancement layers. There can in 
fact be several hierarchical layers building up from a 
base layer with each subsequent layer being dependent 
on the data of one or more lower level layers and en- 
hancing those lower level layers. An illustrative (but per- 
haps not particulariy realistic) example of a layered vid- 
eo program would Include a base layer that consists of 
black and white video of every odd numbered video 
frame, a second layer that consists of black and white 
video of every even numbered video frame, and a third 
layer that consists of color information for all frames. 
Playing only the first layer would get a black and white 
video at )^ frame rate (i.e., somewhat jerky). Playing the 
first and second layers together would yield a black and 
white video at full frame rate (smooth motion). Playing 
all three layers would yield a color video at full frame 
rate. 

[0005] In a layered scheme, a client can request as 
many layers as desired, provided the total bandwidth of 
the layers is not greater than the bandwidth available on 
the network. For example, if the client is connected to 
the tntemet by a 28.8 Kbps modem, then it can feasibly 
subscribe to one, two, or three 8 Kbps video layers. If it 
subscribes to more than three such layers, then conges- 
tion will certainly result and many packets will be 
dropped randomly, resulting in poor video quality. By ob- 
sen^ing packet drops the maximum number of layers 
that can be supported can be detemilned. 

Summary of Invention 

[0006] The present invention is directed at a system 
and process of employing a layered unicast scheme that 
both allows a user to avoid the delay and wasted time 
associated with downloading an audio-video (AV) pro- 
gram that he or she subsequently detenmines to be of 
no interest, and at the same time to obtain higher quality 
versions of a program in the case it is of interest to the 
user. It is noted that there are numerous different layer- 
ing techniques currently in use, and any of them can be 
used In conjunction with the present invention. 



15 



20 



25 



30 



35 



40 



45 



50 



2 



3 



EP 1 233 591 A2 



4 



[0007] The layered unicast scheme according to the 
present invention is generally accomplished as follows. 
In response to a user command to view a particular AV 
program the client requests the server on which the as- 
sociated layered AV data resides to transmit the data to 
the client over the network. In doing so, the client also 
specifies how many consecutive layers beginning with 
the base layer are to be transmitted. This decision is 
based on the bandwidth currently available on the net- 
work link between the client and server. Upon receiving 
the client's request, the server transmits the requested 
data to the client over the network. The client receives 
the data from the server, renders it as it is received, and 
presents it to the viewer via conventional methods. The 
client also caches the received data for future use. 
[0008] The rendered data presented to the user will 
typically be quite rudimentary as typically only the base 
layer, and perhaps a few of the lower-level enhance- 
ment layers will be able to be requested due to the typ- 
ical bandwidth limitations, such as associated the Inter- 
net. The user has three choices at this point in the proc- 
ess. If the AV program is not Interesting to the user, the 
user could do nothing and additional enhancing layer 
data would not be transmitted. Altemately, the user 
could direct that the receipt of an incoming data stream 
be tenminated. Or, finally, the user could review the AV 
program and be interested enough to want to receive a 
higher quality version of the program. To this end, the 
user would instruct the client to provide an enhanced 
version of the program. 

[0009] In the case where the user requests an en- 
hanced version of the AV program, the client would once 
again request that the server provide AV data associat- 
ed with the desired program to be transmitted to it over 
the network. However, this time the client requests as 
many of the consecutive enhancement layers as possi- 
ble given the available bandwidth starting with the low- 
est level layerthatwas not requested in the last iteration. 
In response, the server transmits the requested data in 
the same manner as described previously Upon receipt 
of the requested data, the client combines it with the pre- 
viously stored lower-level layer data using the standard 
methods applicable to the type of layering scheme in- 
volved. The combined data is then used to render the 
program and it Is presented to the user. The rendered 
program will represent a higher quality version of the 
previously viewed program. The client also stores the 
new data for future use, along with the previously stored 
data associated with the same program. 
[0010] At this point, the user has the same three op- 
tions as discussed above, and the process is repeated 
as appropriate depending on which of the options the 
user chooses. For example, if the user wishes to be pro- 
vided with an even higher quality version of the AV pro- 
gram, more enhancement data layers (assuming there 
are any available from the server) are requested by the 
client and processed upon receipt as described above. 
[0011] It Is noted that the foregoing layered unicast 



system and process can be applied to the entire layer 
data streams such that a single client request results in 
the data streams of the requested layer being transmit- 
ted in their entirety from the sen/er. However, this need 

5 not be the case. The available bandwidth may change 
significantly over the period of time it takes to transmit 
the requested layers. In view of this, the foregoing sys- 
tem and process can be applied not to entire layer data 
streams, but to some portion of the streams represent- 

10 ing a segment of the AV program. In other words, in- 
stead of the client requesting a set of layers in their en- 
tirety, it instead requests just an equal-sized, corre- 
sponding, portion of each of the layers involved, based 
on the cun-ently available bandwidth. The layer portions 

15 are corresponding in that they pertain to the same tem- 
poral segment of the AV program. The remaining ac- 
tions described above are the same, except they are 
performed on the data of the layer portions instead. The 
result is that the data associated with a portion of each 

20 layer stream is received, rendered and cached. The cli- 
ent then requests the next sequential portion the AV pro- 
gram layers, and the process of receiving, rendering and 
caching is repeated until the entire program is played to 
the user. It is noted that with the request of each set of 

25 layer portions, the number of layers involved is reas- 
sessed based on the then available networi< bandwidth. 
Thus, each request may result in portions of the same 
number of layers, or fewer, or more, being requested. If 
the user directs that an a higher quality version of the 

30 AV program be played, the client repeats the foregoing 
process except that the client requests, for each seg- 
ment of the program, those layer portions associated 
with the maximum number of enhancement layers pos- 
sible given the current bandwidth conditions on the net- 

35 work starting with the layer that represents the next- 
higher level in regards to the previously received layer 
portions associated with the segment of the program un- 
der consideration. 

[0012] The foregoing layered unicast presentation 
40 system and process can further include a pre-fetching 
option. This option allows a user to select whether ad- 
ditional enhancement layers needed to provide higher 
quality versions of the program are to be requested, re- 
ceived and cached automatically by the client after the 
45 layers associated with a previous lower-quality version 
of the program have all been requested. Note that this 
is done in advance of the user requesting a higher qual- 
ity version. The pre-fetching option results in the layer 
data needed to render a higher quality version of the AV 
50 program being on-hand in the client's memory, thereby 
allowing the client to provide the program to the user 
more quickly. 

[0013] It is noted that while the present layered uni- 
cast scheme was described above in connection with 
55 an AV program, the invention is equally applicable to au- 
dio-only or video-only programs. 
[0014] It is further noted that the layered unicast sys- 
tem and process according to the present Invention can 
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be advantageously employed by Internet web sites to 
sell high quality versions of the AV programs to subscrib- 
ers visiting the web site. A "base quality" version of a 
program could be offered to a site visitor for free or for 
a nominal fee. If the base version of the AV program is ^ 
of sufficient Interest, the visitor could subscribe for a fee 
to view an improved quality version of the program. This 
is accomplished as described above with the enhance- 
ment layers being sent to the client computer associated 
with the visitor. The client computer then combines the 
enhancement layer data with the previously cached lay- 
er data to produce a higher quality version of the pro- 
gram for the visitor to view. The visitor could then repeat 
the request to view even high quality versions of the pro- 
gram as long as the sever associated with the web site 
has higher level enhancement layers available. 
[001 5] In addition to the just described benefits, other 
advantages of the present invention will become appar- 
ent from the detailed description which follows herein- 
after when taken in conjunction with the drawing figures 
which accompany it. 

Brief Description of Drawings 

[0016] The specific features, aspects, and advantag- 
es of the present invention will become better under- 
stood with regard to the following description, appended 
claims, and accompanying drawings where: 
[0017] FIG. 1 is a diagram depicting a general pur- 
pose computing device constituting an exemplary sys- 
tem for implementing the present invention. 
[0018] FIGS. 2A-B present a flow chart diagramming 
an overall process for obtaining progressively higher 
quality versions of an audio and/or video program over 
a client-server based networic in accordance with the 
present invention. 

[0019] FIGS. 3A-B present a flow chart diagramming 
a portion of the overall process of Fig. 2 that has been 
modified to implement a pre-fetching option according 
to the present invention. 

Detailed Description 

[0020] In the following description of the preferred em- 
bodiments of the present invention, reference is made 
to the accompanying drawings which form a part hereof, 
and in which is shown by way of illustration specific em- 
bodiments in which the invention may be practiced. It is 
understood that other embodiments may be utilized and 
structural changes may be made without departing from 
the scope of the present invention. 
[0021] Before providing a description of the preferred 
embodiments of the present invention, a brief, general 
description of a suitable computing environment in 
which the invention may be Implemented will be de- 
scribed. Figure 1 illustrates an example of a suitable 
computing system environment 100. The computing 
system environment 100 is only one example of a suit- 



able computing environment and Is not Intended to sug- 
gest any limitation as to the scope of use or functionality 
of the invention. Neither should the computing environ- 
ment 100 be interpreted as having any dependency or 
requirement relating to any one or combination of com- 
ponents illustrated in the exemplary operating environ- 
ment 100. 

[0022] The invention is operational with numerous 
other general purpose or special purpose computing 
system environments or configurations. Examples of 
well known computing systems, environments, and/or 
configurations that may be suitable for use with the in- 
vention include, but are not limited to, personal comput- 
ers, server computers, hand-held or laptop devices, 
multiprocessor systems, microprocessor-based sys- 
tems, set top boxes, programmable consumer electron- 
ics, networic PCs, minicomputers, mainframe comput- 
ers, distributed computing environments that include 
any of the above systems or devices, and the like. 
[0023] The invention may be described in the general 
context of computer-executable instructions, such as 
program modules, being executed by a computer. Gen- 
erally, program modules include routines, programs, ob- 
jects, components, data structures, etc. that perform 
particular tasks or implement particular abstract data 
types. The invention may also be practiced in distributed 
computing environments where tasks are perfonned by 
remote processing devices that are linked through a 
communications network. In a distributed computing en- 
vironment, program modules may be located in both lo- 
cal and remote computer storage media including mem- 
ory storage devices. 

[0024] With reference to Figure 1 , an exemplary sys- 
tem for implementing the invention includes a general 
purpose computing device in the form of a computer 
110. Components of computer 110 may include, but are 
not limited to, a processing unit 120, a system memory 
1 30, and a system bus 1 21 that couples various system 
components including the system memory to the 
processing unit 120. The system bus 121 may be any 
of several types of bus structures including a memory 
bus or memory controller, a peripheral bus, and a local 
bus using any of a variety of bus architectures. By way 
of example, and not limitation, such architectures in- 
clude Industry Standard Architecture (ISA) bus, Micro 
Channel Architecture (MCA) bus, Enhanced ISA (EISA) 
bus, Video Electronics Standards Association (VESA) 
local bus, and Peripheral Component Interconnect 
(PCI) bus also known as Mezzanine bus. 
[0025] Computer 110 typically includes a variety of 
computer readable media. Computer readable media 
can be any available media that can be accessed by 
computer 110 and includes both volatile and nonvolatile 
media, removable and non-removable media. By way 
of example, and not limitation, computer readable media 
may comprise computer storage media and communi- 
cation media. Computer storage media includes ix>th 
volatile and nonvolatile, removable and non-removable 
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media implemented in any method or technoiogy for 
storage of information such as computer readable in- 
structions, data structures, program modules or other 
data. Computer storage media includes, but is not lim- 
ited to, RAM, ROM, EEPROM, flash memory or other 
memory technology, CD-ROM, digital versatile disks 
(DVD) or other optical disk storage, magnetic cassettes, 
magnetic tape, magnetic disk storage or other magnetic 
storage devices, or any other medium which can be 
used to store the desired information and which can be 
accessed by computer 110. Communication media typ- 
ically embodies computer readable instructions, data 
structures, program modules or other data in a modu- 
lated data signal such as a carrier wave or other trans- 
port mechanism and includes any information delivery 
media. The term "modulated data signal" means a sig- 
nal that has one or more of its characteristics set or 
changed in such a manner as to encode infomfiation in 
the signal. By way of example, and not limitation, com- 
munication media includes wired media such as a wired 
network or direct-wired connection, and wireless media 
such as acoustic, RF, infrared and other wireless media. 
Combinations of the any of the above should also be 
included within the scope of computer readable media. 
[0026] The system memory 130 includes computer 
storage media in the form of volatile and/or nonvolatile 
memory such as read only memory (ROM) 1 31 and ran- 
dom access memory (RAM) 132. A basic input/output 
system 133 (BIOS), containing the basic routines that 
help to transfer information between elements within 
computer 110, such as during start-up, is typically stored 
in ROM 131. RAM 132 typically contains data and/or 
program modules that are Immediately accessible to 
and/or presently being operated on by processing unit 
120. By way of example, and not limitation. Figure 1 il- 
lustrates operating system 134, application programs 
135, other program modules 136. and program data 
137. 

[0027] The computer 110 may also include other re- 
movable/non-removable, volatile/nonvolatile computer 
storage media. By way of example only. Figure 1 illus- 
trates a hard disk drive 141 that reads from or writes to 
non-removable, nonvolatile magnetic media, a magnet- 
ic disk drive 151 that reads from or writes to a remova- 
ble, nonvolatile magnetic disk 152, and an optical disk 
drive 155 that reads from or writes to a removable, non- 
volatile optical disk 1 56 such as a CD ROM or other op- 
tical media. Other removable/non-removable, volatile/ 
nonvolatile computer storage media that can be used in 
the exemplary operating environment include, but are 
not limited to, magnetic tape cassettes, flash memory 
cards, digital versatile disks, digital video tape, solid 
state RAM, solid state ROM, and the like. The hard disk 
drive 141 is typically connected to the system bus 121 
through an non-removable memory internee such as in- 
terface 140, and magnetic disk drive 151 and optical 
disk drive 155 are typically connected to the system bus 
121 by a removable memory interface, such as Interface 



150. 

[0028] The drives and their associated computer stor- 
age media discussed above and illustrated in Figure 1 . 
provide storage of computer readable instructions, data 

5 structures, program modules and other data for the 
computer 110. In Figure 1, for example, hard disk drive 
141 is illustrated as storing operating system 144, ap- 
plication programs 145, other program modules 146, 
and program data 1 47, Note that these components can 

10 either be the same as or different from operating system 
134, application programs 135, other program modules 
136, and program data 137. Operating system 144, ap- 
plication programs 145, other program modules 146, 
and program data 147 are given different numbers here 

15 to illustrate that, at a minimum, they are different copies. 
A user may enter commands and information into the 
computer 1 1 0 through input devices such as a keyboard 
162 and pointing device 161, commonly referred to as 
a mouse, trackball or touch pad. Other input devices (not 

20 shown) may include a microphone, joystick, game pad, 
satellite dish, scanner, or the like. These and other input 
devices are often connected to the processing unit 120 
through a user input interface 160 that is coupled to the 
system bus 121, but may be connected by other Inter- 

25 face and bus stnjctures, such as a parallel port, game 
port or a universal serial bus (USB). A monitor 191 or 
other type of display device is also connected to the sys- 
tem bus 121 via an Interface, such as a video internee 
190. In addition to the monitor, computers may also in- 

30 etude other peripheral output devices such as speakers 
197 and printer 196, which may be connected through 
an output peripheral interface 195. Of particular signifi- 
cance to the present Invention, a camera 163 (such as 
a digital/electronic still or video camera, or film/photo- 

35 graphic scanner) capable of capturing a sequence of im- 
ages 1 64 can also be included as an Input device to the 
personal computer 110. Further, while just one camera 
is depicted, multiple cameras could be included as Input 
devices to the personal computer 110. The images 164 

40 from the one or more cameras are input Into the com- 
puter 110 via an appropriate camera Interface 165. This 
interface 165 is connected to the system bus 121, there- 
by allowing the Images to be routed to and stored in the 
RAM 132, or one of the other data storage devices as- 

45 sociated with the computer 110. However, it is noted that 
image data can be input into the computer 1 1 0 from any 
of the aforementioned computer-readable media as 
well, without requiring the use of the camera 1 63. 
[0029] The computer 1 1 0 may operate in a networked 

50 envirt}nment using logical connections to one or more 
remote computers, such as a remote computer 1 80. The 
remote computer 1 80 may be a personal computer, a 
server, a router, a networic PC, a peer device or other 
common network node, and typically includes many or 

55 all of the elements described above relative to the com- 
puter 110, although only a memory storage device 181 
has been illustrated in Figure 1 . The logical connections 
depicted in Figure 1 include a local area network (LAN) 
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171 and a wide area network (WAN) 173, but may also 
include other networks. Such networking environments 
are commonplace in offices, enterprise-wide computer 
networks, intranets and the Internet. 
[0030] When used in a LAN networking environment, 5 
the computer 110 is connected to the LAN 171 through 
a network interface or adapter 170. When used in a 
WAN networking environment, the computer 110 typi- 
cally includes a modem 172 or other means for estab- 
lishing communications over the WAN 173, such as the 
Intemet. The modem 172, which may be internal or ex- 
temal, may be connected to the system bus 121 via the 
user input interface 160, or other appropriate mecha- 
nism. In a networked environment, program modules 
depicted relative to the computer 11 0, or portions there- 
of, may be stored in the remote memory storage device. 
By way of example, and not limitation, Figure 1 illus- 
trates remote application programs 185 as residing on 
memory device 181. It will be appreciated that the net- 
work connections shown are exemplary and other 
means of establishing a communications link between 
the computers may be used. 

[0031] The exemplary operating environment having 
now been discussed, the remaining part of this descrip- 
tion section will be devoted to a description of the pro- 
gram modules emt)odying the invention. Generally, the 
system and process according to the present invention 
Involves a client obtaining progressively higher quality 
versions of an audio and/or video program over a client- 
server based networic. This is accomplished using what 
will be termed a layered unicast scheme. Specifically, 
referring to the flow diagram of Figs. 2A-B, a user first 
directs the client to obtain a particular AV program (proc- 
ess action 200). This is accomplished via any conven- 
tional client-user interface. In the case where the net- 
wori< is the Intemet, a user will typically select a partic- 
ular program from a web site that provides such pro- 
grams. The client then requests that the server on which 
the layered AV data associated with the desired pro- 
gram resides, transmits the data to the client over the 
networi^ (process action 202). In doing so, the client also 
specifies how many consecutive layers beginning with 
the base layer are to be transmitted. This decision is 
based on the bandwidth cunrently available on the net- 
work link between the client and server. Of course, in 
order to specify the appropriate number of consecutive 
layer, the client must know the specifics of the layering 
scheme employed to segment the AV data, and how to 
identify the desired layers when requesting them from 
the server. The client might already know this informa- 
tion in a case of a network where a standardized layering 
and identification scheme is employed. However, for 
networks such as the present day Intemet where many 
different layering and identification schemes could be 
employed, it Is envisioned that the process action of the 
client requesting the AV data associated with the select- 
ed program will include first obtaining from the server 
specifics as to the layering and Identification scheme 



employed in conjunction with the program. 
[0032] Upon receiving the client's request, the server 
transmits the requested data to the client over the net- 
work (process action 204). The transmission rate should 
at least equal the playback rate so that there is no delay 
in rendering the data for real-time presentation to the 
user by the client. The client receives the data from the 
server, preferably feeds it through a "playout buffer", and 
renders it to the viewer via conventional methods (proc- 
ess action 206). The playout buffer delays the beginning 
of the playback by some small amount of time to accu- 
mulate extra data. This buffering allows the client to en- 
sure the playback rate is constant. Without such buffer- 
ing the rendered program can be "jittery" due to small 
variations in the rate at which the data is received over 
the network. The client also caches the received data 
for future use as will be explained shortly (process action 
208). 

[0033] At this point in the process, the user has three 
choices. If the AV program is not interesting to the user, 
the user could do nothing and additional enhancing lay- 
er data would not be transmitted. To this end, In process 
action 210, it is determined whether the user inputs any 
further commands conceming the previously selected 
AV program. If an input is received from the user, it is 
ascertained whether the user has directed that the re- 
ceipt of the incoming data stream associated with the 
selected AV program be temninated (process action 
212). In other words, has the user cut the AV program 
short. If so, the client tenminates the incoming data 
stream (process action 214). It is noted that the user's 
act of cutting the program short may not end the process 
as this does not necessarily mean the user is not inter- 
ested in viewing enhanced versions of the program. For 
example, the user may view just enough of the lower 
quality base version of the program to decide he or she 
wants to see an enhanced version right away rather than 
continuing to view the lower quality version. Thus, It is 
next determined If the user requests the enhanced ver- 
sion of the selected AV program (process action 216). 
[0034] The third of the aforementioned scenarios in- 
volves the user reviewing the entire AV program and be- 
coming interested enough to want to receive a higher 
quality version of the program. In this case, it would be 
detennlned in process action 212 that the user did not 
direct the receipt of the incoming data stream to be ter- 
minated, but rather requested an enhanced version of 
the program (process action 218). 
[0035] In the case where the user does not request 
an enhanced version of the AV program, no action is 
taken and the client would keep the cached data for the 
amount of time dictated by the caching rules of the net- 
work software employed by the client. If, however, the 
user directs that an enhanced version of the AV program 
be provided (regardless of whether the full program was 
previously viewed or it was cut-off midstream), the client 
would request that enhancing AV data associated with 
the desired program be provided to It over the networic. 
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However, this assumes that the server has additional 
enhancement layers available. Thus, prior to requesting 
the enhancing data, it is first determined in process ac- 
tion 220 whether their are any previously unrequested 
enhancement layers associated with the selected AV 5 
program available from the server. Preferably, the client 
will already know this based on the previously received 
infomiation as to the layering and identification scheme 
employed in conjunction with the selected AV program, 
if additional layers are not available, the user is informed 
of this by the client (process action 222) and the process 
ends. If additional layers are available, then the client 
requests that the server provide the enhancing AV data 
associated with the desired program (process action 
224). Specifically, the client requests as many of the 
consecutive enhancement layers as possible given the 
available bandwidth starting with the lowest level layer 
that was not requested in the last Iteration. In response, 
the server transmits the requested data in the same 
manner as described previously (process action 226). 
[0036] As the requested data is received, the client 
stores the new data (process action 228), and combines 
it with the previously stored lower-level layer data using 
the standard methods applicable to the type of layer da- 
ta involved (process action 230). The combined data is 
then used to render the program and it is presented to 
the user (process action 232). The rendered program 
will represent a higher quality version of the previously 
viewed program. 

[0037] Atthispoint, if the user decides that the AV pro- 
gram is no longer of interest, he or she can again do 
nothing and additional enhancing layer data would not 
be transmitted, or the user could request an even more 
enhanced version of the selected program, or the user 
could terminate the incoming data stream before the full 
program is viewed. Thus, the user has the same three 
options as before. To this end, in process action 234, it 
is determined whether the user inputs any further com- 
mands conceming the previously selected AV program. 
If a user command is input, then the foregoing process 
(of actions 212 through 234) is repeated. In this way, the 
process of obtaining higher and higher quality versions 
of the selected AV program can continue until either the 
user fails to request an enhanced version, or there are 
no remaining enhancement layers available from the 
server. 

[0038] A simple example of the foregoing process 
where only one layer can be streamed at a time due to 
bandwidth limitations is as follows. During the first play- 
back, the base layer is streamed, played, and stored. 
During a user-directed second playback, layer 2 is 
streamed, stored, and played in conjunction with the 
base layer. During a user-directed third playback, layer 
3 is streamed and stored, and played in conjunction with 
the base layer and layer 2. This can continue for as long 
as there are remaining enhancement layers available 
from the server and the user is interested in viewing 
higher quality versions of the AV program. The process 



is similar if more than one layer can be streamed at one 
time. For example, in a case where two layers can be 
streamed at a time within the bandwidth limitations, the 
process would be as follows. During the first playback, 
layer 1 (i.e., the base layer) and layer 2 are streamed, 
played, and stored. During a user-directed second play- 
back, layers 3 and 4 are streamed, stored, and played 
in conjunction with layers 1 and 2. And during a user- 
directed third playback, layers 5 and 6 are streamed and 
stored, and played in conjunction with layers 1,2,3, and 
4. Again this process can continue for as long as there 
are remaining enhancement layers available from the 
server, and the user is interested in viewing enhanced 
versions of the program. 

[0039] It is noted that while the present layered uni- 
cast system and process was described above in con- 
nection with an AV program, the invention is equally ap- 
plicable to audio-only or video-only programs. 
[0040] The foregoing layered unicast system and 
process can be applied to the entire layer data streams 
such that a single client request results in the data 
streams of the requested layer being transmitted in their 
entirety from the server. However, this need not be the 
case. The available bandwidth may change significantly 
over the period of time it takes to transmit the requested 
layers. In view of this, the present layered unicast sys- 
tem and process can be applied not to entire layer data 
streams, but to some portion of the streams represent- 
ing a temporal segment of the AV program. In other 
words, Instead of the client requesting a set of layers in 
their entirety, it instead requests just an equal-sized, cor- 
responding, portion of each of the layers involved, 
based on the currently available bandwidth. The layer 
portions are con-esponding in that they pertain to the 
same temporal segment of the AV program. The proc- 
ess described above in reference to Fig. 2, would apply 
to this piecewise embodiment as well, with process ac- 
tion 202 involving the client requesting layered AV data 
associated with the selected program in a piecewise 
manner. Specifically, a first set of corresponding por- 
tions of a number of consecutive layers of the program 
that it is determined by the client can be received in view 
of the cun-ently available bandwidth of the network is re- 
quested. The client then requests the next sequential 
portion the AV program layers, and so on until it is de- 
termined the entire program has been played to the user 
or the user cuts the program short. It is noted that with 
the request of each set of layer portions, the number of 
layers involved is reassessed based on the then avail- 
able network bandwidth. Thus, each request may result 
in portions of the same number of layers, or fewer, or 
more, being requested. There are several advantages 
of the piecewise embodiment of the present system and 
process. For example, the bandwidth available on the 
network may change enough during the transfer of the 
AV program that either additional data associated with 
a higher level enhancement layer could be added there- 
by improving the quality of the presentation to the user. 
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or conversely the bandwidth could decrease to the ex- 
tent that the data associated with a layer must be 
dropped to prevent excessive loss of the transmitted da- 
ta. The net result Is that the rendered AV program pro- 
vided to the user by the client is the best available over & 
each time period associated with the portion of the data 
sent. Of course, this piecewise embodiment is more cli- 
ent processor intensive in that the client must keep track 
of the number of layers involved in each of the requests 
for a portion of the layer data so that if a higher quality 
version of the program is requested by the user, the cli- 
ent will know which of the higher level layers to start with 
when requesting enhancement data for a particular por- 
tion of the AV program. In addition, the client must re- 
peatedly request layer data rather than having to do so 
just once per program. 

[0041] In the piecewise embodiment, if the user di- 
rects that a higher quality version of the AV program be 
played, process action 220 of Fig. 2 involves the client 
requesting for each segment of the program, those layer 
portions associated with the maximum number of en- 
hancement layers possible given the current bandwidth 
conditions on the network starting with the layer that rep- 
resents the next-higher level in regards to the previously 
received layer portions associated with the same tem- 
poral segment of the program. 
[0042] It is noted tiiat the size of the portion of the data 
in each layer involved in the repeated requests associ- 
ated with the piecewise embodiment can be any de- 
sired. However, it is preferred that the size is selected 
so that the duration of the portion is approximately the 
amount of time that it is expected tiie network bandwidth 
will remain constant. This sizing can be taken to the ex- 
treme if necessary such that each portion is only a single 
packet of the data stream of each of the layers involved 
in a request. 

[0043] The foregoing layered unicast presentation 
system and process can further include a pre-fetching 
option. This option allows a user to select whether ad- 
ditional enhancement layers needed to provide higher 
quality versions of tiie program are to be requested, re- 
ceived and cached automatically by the client after the 
layers associated with a previous lower-quality version 
of the program have been completely received. Note 
that this is done in advance of the user requesting a 
higher quality version. If tiie user requests that tiie client 
automatically obtain the AV data necessary to produce 
higher quality version of a selected program, the proc- 
ess is essentially the same as outiined in Fig. 2 up to 
the point where the first layer or layers of the selected 
program have been received, rendered and cached (i. 
e., up to process action 208). Thereafter, the process 
changes as outiined in Fig. 3. Specifically, during the 
time that the client is receiving, rendering and caching 
the requested AV data, It Is determined whether the user 
has directed that tiie receipt of tiie incoming data stream 
be terminated (process action 300). If not, the client re- 
quests the AV data needed to produce enhanced ver- 



sions of the selected program once all the data to pro- 
duce the lower quality version tiiat is being viewed by 
the user has been requested (process action 302). No 
direction to do so is required from the user. The enhanc- 
ing data would be requested as described previously, 
with as many layers as possible given the available net- 
work bandwidth being requested starting with the layer 
one level up firom the highest level layer of the previously 
requested data. The client could stop once all the en- 
hancing layers associated with the entire program are 
requested for the latest iteration. However, preferably, 
the client requests a set of even higher level enhance- 
ment layers, and so on until all the available layer data 
has been requested. If, however, the user cuts the pro- 
gram short, the client terminates the incoming data 
stream (process action 304). As indicated previously, it 
Is not known at this point whether the user's act of cutting 
the program short meant he or she is not interested in 
viewing enhanced versions of the program, or whether 
wants to see an enhanced version right away rather tiian 
continuing to view the lower quality version. Thus, In the 
case where the user cuts the incoming program short, 
the client then begins requesting tiie AV data needed as 
described above to produce the enhanced version of the 
selected program (process action 306). Of course, since 
the previous version of the program was cut short, only 
the enhancing data associated with the previously re- 
ceived portion of the program can be obtained in the first 
iteration of the requesting procedure. The more rudi- 
mentary layers are requested for the remaining portion 
of the program. As before, the server would transmit the 
requested data (process action 308) and the client 
would receive and cache tiie incoming data (process ac- 
tion 310). It is then determined if tiie user requests that 
a higher quality version of the selected program be pro- 
vided (process action 312). If such a request is made, 
the client combines all the layers of AV data it has 
cached to produce the enhanced version of tiie selected 
program (process action 314). In tfie case of where the 
layers are requested in a piecewise manner, tills last ac- 
tion involves combining all the conresponding layer por- 
tions of each consecutive segment of the AV program. 
The combined data is used to render tiie program and 
it is presented to the user (process action 31 6). It should 
be noted that the enhanced program in the case of the 
pre-fetching option may be of a higher quality than pro- 
duced in the case of the process outiined in Fig. 2 be- 
cause more than one iteration of enhancement layer re- 
quests could have been made, and the data received 
and cached, prior to the user requesting the enhanced 
version of the program. 

[0044] When the user elects to view an enhanced ver- 
sion of a selected AV program, the client may not have 
completed the task of requesting all the layers available 
for the program. Thus, it Is next determined in process 
action 31 8 if there is any remaining layers available from 
the server. If. so process actions 300 tiirough 318 are 
repeated. If, however, all the available data has been 
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requested, the process ends. 
[0045] The pre-fetching option has some attractive 
advantages. First, pre-fetching results in the layer data 
needed to render a higher quality version of the AV pro- 
gram being on-hand in the client's memory, thereby al- s 
lowing the client to provide the program to the user more 
quickly. Additionally, as indicated above, the client can 
in essence continually request and cache layer data as- 
sociated with the selected program. Thus, it is possible 
to have more than one iteration of enhancement layer 
data ready for rendering when the user requests an en- 
hance version of the selected program. As a result, a 
higher quality version of the program can be provided, 
than can be by requesting and rendering the program 
one set of enhancement layers at a time. 
[0046] A variation of the pre-fetching option that is al- 
so advantageous involves continuing to request (as 
needed), receive and cache AV layer data even when 
the user has instructed that the presentation of the as- 
sociated program betemriinated, rather than terminating 
the incoming AV data stream. In this way, if the user sub- 
sequently directs that a higher quality version of the AV 
program be provided, the previously-described issue of 
having only a part of the layer data associated with the 
terminated version of the program is avoided. This is ad- 
vantageous as the higher quality version of the program 
presented to the user would have a generally consistent 
quality throughout. Without the foregoing procedure, the 
latter part of the higher quality program would have a 
noticeable drop in quality level, as the client would have 
to request the lower level layers associated with the ter- 
minated version of the program rather than additional 
enhancing layers. 

[0047] Many wed sites on the Intemet offer AV pro- 
grams that can be streamed to a client computer, such 
as the news and sports web sites mentioned eariier. The 
layered unicast system and process according to the 
present invention can be advantageously employed by 
such sites to sell high quality versions of the AV pro- 
grams to subscribers visiting the web site. In particular, 
a "base quality" version of a program could be offered 
to a site visitor for free, or for a nominal fee. This base 
quality version of the program can be the version that is 
initially requested and rendered by a client computer as- 
sociated with the site visitor, which includes the base 
layer associated with the program and as many en- 
hancement layers as the available bandwidth will allow. 
However, the base quality version of the AV program 
can be limited to the base layer and perhaps a small 
number of enhancement layers as dictated by the server 
associated with the web site, even if the client initially 
requests more layers. The purpose of restricting the 
number of layers provided initially to a site visitor is to 
let the visitor view a version of the AV program that is 
just good enough to spark curiosity and entice the visitor 
to purchase improved version. If the base version of the 
AV program is of sufficient interest, the visitor could sub- 
scribe for a fee to view an improved quality version of 



the program. This Is accomplished as described above 
with the enhancement layers being sent to the client 
computer associated with the visitor. The client compu- 
ter then combines the enhancement layer data with the 
previously cached layer data to produce a higher quality 
version of the program for the visitor to view. The visitor 
could then repeat the request to view even high quality 
versions of the program as long as the sever associated 
with the web site has higher level enhancement layers 
available. 

[0048] As an example of the forgoing process, as- 
sume a user visits a sports web site on the Intemet that 
provides hockey video highlights. The visitor can "dick 
on" one of the highlights listed on the site and watch it 
at the "base" quality level for free. At this quality level, 
the visitor might be able to generally see what is hap- 
pening, but may not see enough detail to even make out 
the puck. If the highlight Is not interesting to the visitor, 
no further requests would be made, or the visitor might 
even halt the playback before it is complete. However, 
if the highlight is of interest, the visitor is invited to sub- 
scribe to higher quality versions for a fee. The payment 
provisions can be handled via any conventional 
scheme, such as those currently in use on commercial 
Intemet web sites. This time, the visitor sees improved 
detail, including the puck. Playing it a third time may in- 
troduce more video frames, making the playback 
smoother. 

[0049] As another example, many web sites contain 
audio samples or songs. These sites can offer access 
to a lower-quality version of the audio program for free. 
Then, if the visitor is interested in higher quality versions 
of the program, the transfer of additional quality enhanc- 
ing audio data layers would require the paymentof a fee. 
[0050] In regard to payment for higher quality versions 
of a program, a single fee can be charged to the visitor 
for as many "improvement" requests the visitor wishes 
to make, or alternately, the visitor can be charged for 
each request. 



Claims 

1 . A computer-implemented process for obtaining pro- 
gressively higher quality versions of an audio and/ 
or video program over a client-server based net- 
work, comprising a client computer perfomning the 
process actions of: 

requesting a base quality version of the pro- 
gram from a server over the networic, wherein 
the base quality version of the program com- 
prises at least a base layer of a layered unicast; 
receiving and caching the requested layer data 
associated with the base quality version of the 
program; 

requesting at least one enhancement layer of 
the layered unicast from the server over the net- 
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work; 

receiving and caching the requested enhance- 
ment layer data; and 

combining the requested enhancement layer 
data with the previously cached layer data as- 
sociated with the base quality version of the 
program as it is received to produce a higher 
quality version of the program. 

2. The process of Claim 1 , further comprising a proc- 
ess action of rendering the base quality version of 
the program as the requested data Is received and 
presenting it to the user. 

3. The process of Claim 2, further comprising the proc- 
ess actions of: 

detenmlning if the user directs that the presen- 
tation of the base quality version of the program 
be terminated; 

terminating the presentation of the base quality 
version of the program to the user. 

4. The process of Claim 3, wherein the process action 
of terminating the presentation comprises the ac- 
tion of terminating the incoming data stream asso- 
ciated with the requested base quality version of the 
program. 

5. The process of Claim 3, wherein the process action 
of temiinating the presentation comprises the ac- 
tions of stopping the rendering of the base quality 
version of the program, while continuing to receive 
and cache the incoming data stream associated 
with the requested base quality version of the pro- 
gram. 

6. The process of Claim 1 , further comprising a proc- 
ess action of rendering the higher quality version of 
the program from the combined layer data and pre- 
senting it to the user. 

7. The process of Claim 6, further comprising the proc- 
ess actions of: 

determining if the user directs that the presen- 
tation of the higher quality version of the pro- 
gram be terminated; 

terminating the presentation of the higher qual- 
ity version of the program to the user. 

8. The process of Claim 7, wherein the process action 
of tenmlnating the presentation comprises the ac- 
tion of terminating the incoming data stream asso- 
ciated with the requested higher quality version of 
the program. 

9. The process of Claim 7, wherein the process action 



of tenninating tiie presentation comprises the ac- 
tions of stopping the rendering of the higher quality 
version of the program, while continuing to receive 
and cache the incoming data stream associated 
5 with the requested higher quality version of the pro- 
gram. 

10. The process of Claim 1, wherein the process ac- 
tions of requesting at least one enhancement layer, 
receiving and caching the requested enhancement 
layer data and combining the requested enhance- 
ment layer data with the previously cached layer da- 
ta associated with the base quality version of the 
program as it is received to produce said higher 
quality version of tiie program, are performed only 
when a user directs the client to provide a higher 
quality version of tiie program in comparison to the 
base quality version. 

11. The process of Claim 1, wherein the process ac- 
tions of requesting at least one enhancement layer, 
receiving and caching the requested enhancement 
layer data and combining the requested enhance- 
ment layer data with the previously cached layer da- 
ta associated with the base quality version of the 
program as it is received to produce said higher 
quality version of tiie program, are performed auto- 
matically once all the requested layer data associ- 
ated with the base quality version of the program 
has been received and cached. 

12. The process of Claim 1 , further comprising the proc- 
ess actions of: 

requesting at least one additional enhance- 
ment layer of the layered unicast from the serv- 
er over the networit; 

receiving and caching the requested additional 
enhancement layer data; and 
combining flie requested additional enhance- 
ment layer data witii the previously cached lay- 
er data associated with the base and higher 
quality versions of the program as it is received 
to produce an enhanced higher quality version 
of the program. 

13. The process of Claim 1 , further comprising the proc- 
ess actions of: 

ascertaining whetiier the server has any re- 
maining enhancement layers associated with 
the program available; and 
whenever it is ascertained that the server has 
at least one remaining enhancement layer as- 
sociated with the program, 
requesting at least one additional enhance- 
ment layer of the layered unicast from the serv- 
er over the networic. 



15 



20 



25 



30 



35 



40 



45 



50 



10 



19 



EP1 233 591 A2 



20 



receiving and caching the requested additional 
enhancement layer data, and 
combining the requested additional enhance- 
ment layer data with the previously cached lay- 
er data associated with the base and higher s 
quality versions of the program as it Is received 
to produce an enhanced higher quality version 
of the program. 



comprises the action of requesting as many en- 
hancement layers, in the order of their position in 
the hierarchy starting with the layer next higher in 
the hierarchy from the highest level layer requested 
in association with the base quality version of the 
program, as can be transmitted from the server to 
the client without exceeding the available band- 
width of the network. 



14. The process of Claim 13, wherein the process ac- 
tions of requesting at least one additional enhance- 
ment layer, receiving and caching the requested ad- 
ditional enhancement layer data and combining the 
requested additional enhancement layer data with 
the previously cached layer data associated with 
the base and higher quality versions of the program 
to produce said enhanced higher quality version of 
the program, are performed only when a user di- 
rects the client to provide the enhanced higher qual- 
ity version of the program. 

15. The process of Claim 13, wherein the process ac- 
tions of requesting at least one additional enhance- 
ment layer, receiving and caching the requested ad- 
ditional enhancement layer data and combining the 
requested additional enhancement layer data with 
the previously cached layer data associated with 
the base and higher quality versions of the program 
to produce said enhanced higher quality version of 
the program, are performed automatically once all 
the requested layer data associated with the higher 
quality version of the program has been received 
and cached. 

1 6. The process of Claim 1 3, further comprising a proc- 
ess action of infonning the user that an enhanced 
higher quality version of the program cannot be pro- 
vided whenever it is ascertained that the server 
does not have any remaining enhancement layers 
associated with the program available. 

17. The process of Claim 1 , wherein the layers of the 
layered unicast are related hierarchically in that the 
lowest level layer is a base layer and each subse- 
quently higher level layer adds enhancing informa- 
tion for enhancing the quality of the program that 
can be rendered from the layers preceding it in the 
hierarchy, and wherein the process action of re- 
questing a base quality version of the program from 
a server over the network comprises the action of 
requesting as many layers, in the order of their po- 
sition in the hierarchy starting with the base layer, 
as can be transmitted from the server to the client 
without exceeding the available bandwidth of the 
networic. 

18. The process of Claim 17, wherein the process ac- 
tion of requesting at least one enhancement layer, 



10 19. The process of Claim 1, wherein the process ac- 
tions of requesting a base quality version of the pro- 
gram and requesting at least one enhancement lay- 
er comprises requesting that the data making up 
each layer be provided in its entirety. 

15 

20. The process of Claim 1 , wherein the process action 
of requesting a base quality version of the program 
comprises the action of requesting the data making 
up each layer of the base quality version in sequen- 
ce tial, equal-sized, temporally corresponding portions 

such that the layer portions associated with a time 
segment at the beginning of the program are re- 
quested first, and then the layer portions associated 
with the next sequential time segment of the pro- 
25 gram are requested, and so on. 

21. The process of Claim 20, wherein the layers of the 
layered unicast are related hierarchically In that the 
lowest level layer is a base layer and each subse- 

30 quently higher level layer adds enhancing informa- 
tion for enhancing the quality of the program that 
can be rendered firom the layers preceding it in the 
hierarchy, and wherein the process action of re- 
questing the data making up each layer of the base 

35 quality version in sequential, equal-sized, temporal- 
ly corresponding portions comprises the action of 
requesting said layer portions from as many layers, 
in the order of their position in the hierarchy starting 
with the base layer, as can be transmitted from the 

40 server to the client without exceeding the available 
bandwidth of the networic. 

22. The process of Claim 20, wherein the process ac- 
tion of requesting at least one enhancement layer 

45 of the program comprises the action of requesting 
the data making up each enhancement layer in se- 
quential, equal-sized, temporally corresponding 
portions such that the layer portions associated with 
time segment at the beginning of the program are 
50 requested first, and then the layer portions associ- 
ated with the next sequential time segment of the 
program are requested, and so on. 

23. The process of Claim 22, wherein the process ac- 
55 tion of requesting the data making up each en- 
hancement layer in sequential, equal-sized, tempo- 
rally con-esponding portions, comprises the action 
of requesting said enhancement layer portions from 
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as many enhancement layers, in the order of their 
position in the hierarchy starting with the layer next 
higher in the hierarchy from the highest level layer 
requested in association with the base quality ver- 
sion of the program, as can be transmitted from the 
server to the client without exceeding the available 
bandwidth of the network. 

24. The process of Claim 22, wherein the length of each 
time segment of the program is matched to the rate 
at which the available bandwidth varies on the net- 
work such that each time segment is short enough 
that the network bandwidth does not vary signifi- 
cantly over the period. 

25. A client-server based computer network for obtain- 
ing progressively higher quality versions of an audio 
and/or video program, comprising: 

a client comprising at least one general pur- 
pose computing device; and 
a computer program comprising program mod- 
ules executable by the client, wherein the client 
is directed by the program modules to, 
receive an instruction from a user to provide the 
program for viewing, 

request a base quality version of the program 
from a server over the network, wherein the 
base quality version of the program comprises 
at least a base layer of a layered unicast, 
receive and cache the requested layer data as- 
sociated with the base quality version of the 
program, 

render the base quality version of the program 
as the requested data is received and present 
it to the user, 

determining if the user directs that a higher 
quality version of the program be provided for 
viewing, 

whenever it Is determined that the user has di- 
rected a higher quality version of the program 
to be provided, 

request at least one enhancement layer of the 
layered unicast from the server over the net- 
work, 

receive and cache the requested enhancement 

layer data, 

combine the requested enhancement layer da- 
ta with the previously cached layer data asso- 
ciated with the base quality version of the pro- 
gram as it is received to produce the higher 
quality version of the program, and 
render the higher quality version of the program 
from the combined layer data and present it to 
the user. 

26. The networic of Claim 25, further comprising a pro- 
gram modules for: 



detemiining if the user directs that the presen- 
tation of the base quality version of the program 
be terminated; 

whenever it is detemiined that the user has di- 
5 rected that the presentation of the base quality 

version of the program be terminated, terminat- 
ing said presentation. 

27. A computer-readable medium having computer-ex- 
10 ecutable instructions for obtaining progressively 

higher quality versions of an audio and/or video pro- 
gram over a network, said computer-executable in- 
structions comprising: 

15 requesting a base quality version of the pro- 

gram, wherein the base quality version of the 
program comprises at least a base layer of a 
layered unicast; receiving and caching the re- 
quested layer data associated with the base 

20 quality version of the program; 

rendering the base quality version of the pro- 
gram as the requested data is received and pre- 
senting it to the user; 

upon a user directing that a higher quality ver- 
25 sion of the program being provided, requesting 

at least one enhancement layer of the layered 
unicast from the server over the networtc; 
receiving and caching the requested enhance- 
ment layer data; 
30 combining the requested enhancement layer 

data with the previously cached layer data as- 
sociated with the base quality version of the 
program as it is received to produce a higher 
quality version of the program; and 
35 rendering the higher quality version of the pro- 

gram from the combined layer data and pre- 
senting it to the user. 

28. A process of using a computing device to provide 
40 progressively higher quality versions of an audio 

and/or video program over a client-server based 
network, comprising a sen/er computer performing 
the process actions of: 

45 upon a first request from a client computer over 

the networi< to provide the program, providing 
a base quality version of the program to the cli- 
ent over the networic, wherein the base quality 
version of the program comprises at least a 

50 base layer of a layered unicast; 

upon a subsequent request from a client com- 
puter over the network to provide a higher qual- 
ity version of the program, 
requesting payment of a prescribed fee, 

55 providing at least one enhancement layer of the 

layered unicast to the client over the network 
upon payment of the prescribed fee. 
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29. The process of Claim 28, wherein the process ac- 
tion of requesting payment of the prescribed fee is 
performed only upon a first request from a client 
computer over the network to provide a higher qual- 
ity version of the program, and is not repeated 
thereafter. 

30. A computer-implemented process for providing pro- 
gressively higher quality versions of an audio and/ 
or video program over a client-server based net- 
work, comprising a server computer performing the 
process actions of: 

providing a base quality version of the program 
to a client computer over the network, wherein 
the base quality version of the program com- 
prises at least a base layer of a layered unicast; 
and 

providing at least one enhancement layer of the 
layered unicast to the client over the networi< 
without also providing any layer of the base 
quality version of the program. 

31. The process of Claim 30, wherein the process ac- 
tion of providing a base quality version of the pro- 
gram comprises the action of providing the data 
making up each layer of the base quality version in 
sequential, equal-sized, temporally corresponding 
portions such that the layer portions associated with 
a time segment at the beginning of the program are 
provided first, and then the layer portions associat- 
ed with the next sequential time segment of the pro- 
gram are provided, and so on. 

32. The process of Claim 30, wherein the process ac- 
tion of providing at least one enhancement layer of 
the program comprises the action of providing the 
data making up each enhancement layer in sequen- 
tial, equal-sized, temporally corresponding portions 
such that the layer portions associated with time 
segment at the beginning of the program are pro- 
vided first, and then the layer portions associated 
with the next sequential time segment of the pro- 
gram are provided, and so on. 

33. A client-server based computer networi^ for provid- 
ing progressively higher quality versions of an audio 
and/or video program, comprising: 

a server comprising at least one general pur- 
pose computing device; and 
a computer program comprising program mod- 
ules executable by the server, wherein the serv- 
er is directed by the program modules to, 
upon a first request fix>m a client computer over 
the networi< to provide the program, provide a 
base quality version of the program to a client 
computer over the networtc, wherein the base 



quality version of the program comprises at 
least a base layer of a layered unicast, and 
upon a subsequent request from a client com- 
puter over the network to provide a higher qual- 
5 ity version of the program, providing at least 

one enhancement layer of the layered unicast 
to the client over the networi< without also pro- 
viding any layer of the base quality version of 
the program. 

10 

34. A computer-readable medium having computer-ex- 
ecutable instructions for providing progressively 
higher quality versions of an audio and/or video pro- 
gram over a client-server based networt^, said com- 
15 puter-executable instructions comprising: 



providing a base quality version of the program 
to a client computer over the network, wherein 
the base quality version of the program com- 
20 prises at least a base layer of a layered unicast; 

and 

providing at least one enhancement layer of the 
layered unicast to the client over the network 
without also providing any layer of the base 

25 quality version of the program, wherein the at 

least one enhancement layer is a layer capable 
of being combined with the layer or layers of 
the base quality version of the program previ- 
ously provided to produce said higher quality 

30 version of the program. 
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